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PATENT 

Attorney's Docket Number: 5905.0035-01 



!S IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



ASSISTANT COMMISSIONER FOR PATENTS *s m« 



3 Washington, D.C. 20231 »S fi^ 



Prior Application: Art Unit: 3713 S^=o 

Examiner: M. O'Neill ^ ™ 



SIR: This is a request for filing a 

□ Continuation □ Continuation-in-Part ■ Divisional Application under 37 C.F.R. 
§ 1.53(b) of pending prior application Serial No. 09/975.966 filed November 21. 1997 
of Toshihiro Naaoshi. Takuji Masuda. Koki Koiwa. Takayuki Kazama. and Ryo Ikawa 
for GAME DEVICE. PICTURE DATA FORMING METHOD AND MEDIUM . 



1 . ■ Enclosed is a complete copy of the prior application including the oath or 

Declaration and drawings, if any, as originally filed. I hereby verify that the 
attached papers are a true copy of prior application Serial No. 08/975.966 
as originally filed on November 21. 1997 . 

2. □ Enclosed is a substitute specification under 37 C.F.R. § 1.125. 

3. ■ Cancel Claims 1-14 and 24-27 . 



4. ■ A Preliminary Amendment is enclosed. 

5. ■ The filing fee is calculated on the basis of the claims existing in the prior 

application as amended at 3 and 4 above. 
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Basic Application Filing Fee 


$760 


$ 760.00 




Number of 
Claims 




Basic 


Extra 
Claims 






Total Claims 


9 




20 


0 


x$18 


0.0 


Independent Claims 


1 




3 


0 


x$78 


0.0 


[ ] Presentation of Multiple Dep. Claim(s) 


+$260 


0.0 


Subtotal 


$ 760.00 


Reduction by 1/2 if small entity 


0.0 


TOTAL APPLICATION FILING FEE 


$ 760.00 



6.1 A check in the amount of $760.00 to cover the filing fee is enclosed. 



7. ■ The Commissioner is hereby authorized to charge any fees which may be 

required including fees due under 37 C.F.R. § 1.16 and any other fees due 
under 37 C.F.R. § 1 .17, or credit any overpayment during the pendency of 
this application to Deposit Account No. 06-0916. 

8. ■ Amend the specification by inserting before the first line, the sentence: 

--This is a □ continuation ■ division of application Serial No. 08/975,966, . 
filed November 21. 1997 . all of which are incorporated herein by reference.- 

9. □ New formal drawings are enclosed. 

10. ■ The prior application is assigned of record to: Kabush iki Kaisha Seaa 

Enterprises . 

1 1 . ■ Priority of application Serial No. 8-312459 . filed on November 22. 1996 in 

Japan (country) is claimed under 35 U.S.C. § 119. A certified copy 

□ is enclosed or ■ is on file in the prior application. 

12. □ A verified statement claiming small entity status 

□ is enclosed or □ is on file in the prior application. 

1 3 ■ The power of attorney in the prior application is to at least one of the 

following: FINNEGAN, HENDERSON, FARABOW, GARRETT & DUNN ER, 
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LLP., Douglas B. Henderson, Reg. No. 20,291; Ford F. Farabow, Jr., Reg. 
No. 20,630; Arthur S. Garrett, Reg. No. 20,338; Donald R. Dunner, Reg. 
No. 19,073; Brian G. Brunsvold, Reg. No. 22,593; Tipton D. Jennings, IV, 
Reg. No. 20,645; Jerry D. Voight, Reg. No. 23,020; Laurence R. Hefter, Reg. 
No. 20,827; Kenneth E. Payne, Reg. No. 23,098; Herbert H. Mintz, Reg. 
No. 26,691; C. Larry O'Rourke, Reg. No. 26,014; Albert J. Santorelli, Reg. 
No. 22,610; Michael C. Elmer, Reg. No. 25,857; Richard H. Smith, Reg. 
No. 20,609; Stephen L. Peterson, Reg. No. 26,325; John M. Romany, Reg. 
No. 26,331; Bruce C. Zotter, Reg. No. 27,680; Dennis P. O'Reilley, Reg. 
No. 27,932; Allen M. Sokal, Reg. No. 26,695; Robert D. Bajefsky, Reg. 
No. 25,387; Richard L. Stroup, Reg. No. 28,478; David W. Hill, Reg. 
No. 28,220; Thomas L. Irving, Reg. No. 28,619; Charles E. Lipsey, Reg. 
No. 28,165; Thomas W. Winland, Reg. No. 27,605; Basil J. Lewris, Reg. 
No. 28,818; Martin I. Fuchs, Reg. No. 28,508; E. Robert Yoches, Reg. 
No. 30,120; Barry W. Graham, Reg. No. 29,924; Susan Haberman Griffen, 
Reg. No. 30,907; Richard B. Racine, Reg. No. 30,415; Thomas H. Jenkins, 
Reg. No. 30,857; Robert E. Converse, Jr., Reg. No. 27,432; Clair X. Mullen, 
Jr., Reg. No. 20,348; Christopher P. Foley, Reg. No. 31,354; John C. Paul, 
Reg. No. 30,413; David M. Kelly, Reg. No. 30,953; Kenneth J. Meyers, Reg. 
No. 25,146; Carol P. Einaudi, Reg. No. 32,220; Walter Y. Boyd, Jr., Reg. 
No. 31,738; Steven M. Anzalone, Reg. No. 32,095; Jean B. Fordis, Reg. 
No. 32,984; Roger D. Taylor, Reg. 28,992; Barbara C. McCurdy, Reg. 
No. 32,120; James K. Hammond, Reg. No. 31,964; Richard V. Burgujian, 
Reg. No. 31,744; J. Michael Jakes, Reg. No. 32,824; Thomas W. Banks, 
Reg. No. 32,719; Christopher P. Isaac, Reg. No. 32,616; Bryan C. Diner, 
Reg. No. 32,409; M. Paul Barker, Reg. No. 32,013; Andrew Chanho Sonu, 
Reg. No. 33,457; David S. Forman, Reg. No. 33,694; Vincent P. Kovalick, 
Reg. No. 32,867; James W. Edmondson, Reg. No. 33,871; Michael R. 
McGurk, Reg. No. 32,045; Joann M. Neth, Reg. No. 36,363; Gerson S. 
Panitch, Reg. No. 33,751; Cheri M. Taylor, Reg. No. 33,216; Charles E. Van 
Horn, Reg. No. 40,266; Linda A. Wadler, Reg. No. 33,218; Jeffrey A. 
Berkowitz, Reg. No. 36,743; Michael R. Kelly, Reg. No. 33, 921; and James 
B. Monroe, Reg. No. 33,971. 

14. □ The power appears in the original declaration of the prior application. 

1 5. □ Since the power does not appear in the original declaration, a copy of the 

power in the prior application is enclosed. 

16. ■ Please address all correspondence to FINNEGAN, HENDERSON, 

FARABOW, GARRETT and DUNNER, L.L.P., 1300 I Street, N.W., 
Washington, D.C. 20005-3315. 
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17. □ 



Recognize as associate attorney 



(name, address & Reg. No.) 



1 8. □ Also enclosed is 



PETITION FOR EXTENSION . If any extension of time is necessary for the filing of this 
application, including any extension in the parent application, Serial No. 08/975.966 . 
filed November 21. 1997 . for the purpose of maintaining copendency between the 
parent application and this application, and such extension has not otherwise been 
requested, such an extension is hereby requested, and the Commissioner is authorized 
to charge necessary fees for such an extension to our Deposit Account No. 06-0916. A 
duplicate copy of this paper is enclosed for use in charging the deposit account. 



Respectfully submitted, 



FINNEGAN, HENDERSON, FARABOW, 
GARRETT & DUNNER, LLP. 




Richard V. Burgujian 
Reg. No.: 31,744 



Dated: October 12, 1999 



PATENT 

Attorney Docket No. 5905.0035-01 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



PRIOR APPLICATION: 

Group Art Unit: 3713 
Examiner: M. O'Neill 



In re Application of: 

Toshihiro NAGOSHI et al. 

Divisional Application of: 
Serial No.: 08/975,966 
Filed: November 21, 1997 

Filed: Herewith 

For: GAME DEVICE, PICTURE DATA 
FORMING METHOD AND MEDIUM 

Assistant Commissioner for Patents 
Washington, D.C. 20231 



Sir: 

PRELIMINARY AMENDMENT 

Prior to examination, please amend the application as follows: 
IN THE SPECIFICATION : 

Page 9, line 20, change "Figure 7 describes an example" to -Figures 7(a) and 
7(b) describe examples-. 

Page 21, line 21, change "Figure 7 shows" to -Figures 7(a) and 7(b) show-. 

Page 22, line 20, change "Figure 7" to -Figures 7(a) or 7(b)-. 



LAW OFFICES 

Finn eg an, Henderson, 
Farabow, Garrett, 

8 DUNNER,L.L.R 

1300 I STREET, N. W. 
WASHINGTON, D . C.20005 
202-408-4000 



REMARKS 



By this Preliminary Amendment, Applicants have amended the specification in 
order to conform the description of the drawings to the drawings as-filed. No new 
matter has been added. 

Please grant any extensions of time required to enter this response and charge 

any additional required fees to our deposit account 06-0916. 

Respectfully submitted, 

FINNEGAN, HENDERSON, FARABOW, 
GARRETT & DUNNER, L.L.P. 



By: OUJM ^g-^KA^f /Z^Jfc. 



Richard V. Burgujian 
Reg. No. 31,744 



Dated: October 12, 1999 



LAW OFFICES 

Finnecan, Henderson, 
Farabow, Garrett, 

S DUNNER, L.L.P. 

t300 I STREET, N. W. 
WASHINGTON, D.C.20005 
202-408 -4000 
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GAME DEVICE, PICTURE DATA FORMING METHOD AND MEDIUM 



BACKGROUND OF THE INVENTION 



5 The present 

particularly, 
installed at 
expressing more 



this 



amusement 



prcgres 



f computer 



video 



With the 
utilizing 
This type of 
large number of 
and various game 
15 have been supplied 



expressions on a 



invention relates to a video game device- More 
invention relates to a game device which is 
centers or at home and which is capable of 
realistic pictures. 



s of computer technology, video game devices 
graphics technology have come to be widely used . 
game devices are widely accepted by users. A 
various kinds of game devices have been devised 
software products which run on such game devices 



It is desirable that pictures be displayed in more realistic 



screen so that users would be able to enjoy video 



games fully. Fox example, with a vehicle race such as a car race, 
20 it is desirable that movements of cars and the background be 
expressed naturally and that anything which may occur during the 
drive, for exampl e, reflection of light on a windshield be expressed 
as special effects on a screen. Moreover, it will be interesting 
if traces of tire slips of a car appear. 



On the other hand, since complicated arithmetic operations 
such as coordinate transformation are repeated for three- 
dimensional screen display, the amount of operation borne by CPU 
becomes enormous. Accordingly, if special effects or the like of 
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expressions 



picture 

displayed on the 
to be used for 



are performed, the nuinber of polygons to be 
screen must be decreased by the amount of operation 
;»uch special effects. 



Therefore, 
a video game 
game player can 



it is a first object of this invention to provide 
device capable of expressing a picture with which a 
perceive da22ling light from a light source . 



It is a second object of this invention to provide a game device 
10 capable of expressing, on a screen, traces of a moving object in 
a video game. 



15 



20 



It is a third object of this invention to provide a method of 
decreasing the amount of operation in a drawing routine when 
developments of j game in the three-dimensional virtual space are 
displayed on a two-dimensional screen so that pictures on the screen 
may seen to be three-dimensional. 

^SUMMARY OF THE INVENTION 

In order to achieve the above-mentioned objects , a game device 
of the present invention displays a picture of a scene that has 
come into view by moving a visual point of a virtual camera in a 
three-dimensional virtual space, and the game device comprises a 
25 flare processing means (S102 through S118) for forming a flare in 
, a picture when a light source exists within view. The flare 



processing means 
means (SI 06) for 



comprises: a line-of -sight vector generating 
obtaining a line-of -sight vector which shows a 



line-of -sight direction of the visual point; a ray vector 



NDJ 20 '97 *24 



PI^S^^RS*? POP- 17t4 



20 



25 



generating means (SI 04) for obtaining a ray vector which shows a 
direction of the light source from the visual point; an inner 
product calculating means (S108) for calculating an inner product 
of the line-of-s Lght vector and the ray vector; and a flare forming 
5 means (S112 through SI 18) for forming a flare having intensity 
according to the inner product in the picture. This makes it 
possible to form a flare in accordance with the position of the 
light source from the visual point and/ or the intensity of the light 
source- Expressions are made more closer to real scenes and it 
1 0 is possible to f crm game pictures with strengthened image effects , 
thereby making a game more amusing. 

The game device of this invention further comprises a 
determining mears (S110) for activating the flare forming means 
15 on the basis of the results of comparison of the inner product with 
a reference value. This makes it possible to prevent lowering of 
Lity by avoiding the formation of flares and 
: processing when the intensity of the light source 



the picture qua 
performing flare 



is not strong enough to generate flares. 

The flare foiming means increases a degree of whiteness of the 
picture in accordance with the inner product (SI 12) , This causes 
an influence (or flare effect) of the flares upon the picture to 
be expressed - 

The flare forming means forms a picture of flare polygons having 
transparency according to the inner product (S114, S118). This 
makes it possibl^ to express flares of a camera lens. 
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The flare forming means conducts, with the inner product being 
between a predetermined upper limit and a predetermined lower limit , 
of the processing to add whiteness to the picture 
according to the inner product and the processing to form a flare 
polygon having transparency according to the inner product- This 
makes it possible to avoid formation of flares with a light source 
having weak intensity and to avoid excessive flare processing with 
a light source having strong intensity. 



10 The flare 

linking the visual 
makes it possibl 
camera. 



15 



f<pnning means forms the flare on a straight line 
point with the light source (S116, S118) * This 
e to express the incidence of rays into a virtual 



A game device of this invention is a game device for displaying, 
as a picture, a scene having come into view by moving a visual point 
in a three-dimensional virtual space. The game device comprises 
a flare processing means for forming a flare in the picture when 
a light source exists within view of the visual point. The flare 
20 processing means determines a flare degree in accordance with the 
likes of a position of the light source within view and intensity 
of the light source. In doing so, it is possible to determine the 
flare degree at aa appropriate value by using a table or a function 
in consideration of the above-mentioned upper limit and lower limit 
25 or the like. 

The flares are expressed by, for exanple, displaying on a 
screen a flat figure having a comparatively higher degree of 
whiteness than that of the background or a hollow flat figure. 
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Repeating display and no display of the flares in a short period 
of time, that is, flashing makes it possible to make it look like 
a real situation of flare formation- Moreover, it is possible to 
avoid continuous obstruction on a picture of the background by 
5 flares (particularly, flare pictures which are not hollow), 
thereby avoiding interruption with operation of a game. 

It is possible to make the flares look like real ones by 
displaying a plurality of flares on a straight line corresponding 
10 to an incident ray. In doing so, it is possible to reduce a burden 
on arithmetic operation by forming a plurality of flares to be 
displayed by using similar figures. 



The light s 
15 dimensional virtual 
normal position 
in order to generate 
scene , This makes 
by intentionally 
20 and by generating 



ource is a virtual sun located in the three- 
space. The virtual sun is relocated from a 
o a position within view of a predetermined scene 
the flare in the picture on the predetermined 
it possible to dramatically present a game scene 
causing the light source to exist in the game scene 
flares . 



A game device of this invention is a game device for displaying, 



as a picture, an 



object moving in accordance with developments of 



a game. The game device comprises: a means (Si 32) for reading a 
25 present position of the object; and a trace mark drawingmeans (S132 
.through S153) for drawing a trace mark in length within a 
predetermined range from the present position and for 
extinguishing a bottom position of the trace mark by making it 
gradually lighter in color with the lapse of time. This makes it 
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possible to reduce 
by reducing tra 



each portion ha\ 
color from a top 



the amount of operation for picture processing 
:e polygons of, for example, tires. 



It is preferable that the trace mark consist of plural portions , 



ing an assigned pattern which becomes lighter in 
position of the trace mark toward a bottom position 
of the trace mar c. As the trace pattern assigned to each portion, 
a previously for cried pattern can be used. It is possible to change 
the transparency of a basic trace pattern and use it as a pattern 
10 for each portion. 

The trace mark drawing means extends only the top position of 
the trace mark (S142 through S152) when the present position of 
said object is located less than a predetermined value apart from 

15 the top position of the drawn trace mark (S134 ) , and the trace mark 
drawing means moves, by the predetermined value, the trace mark 
in its entirety toward the present position of the object (S136 
through S158) when the present position of the object is located 
not less than the predetermined value apart from the top position 

20 of the drawn trace mark- This makes it possible to draw the trace 
mark which will not give a sense of incompatibility to a game player, 
and to limit the length of the trace mark in its entirety to a 
constant length aWi restrain the amount of operation for the picture 



processing from 



increasing- 



25 



The trace mark drawing means adjusts the timing to extinguish 



the drawn trace 
through S158). 



according to a moving speed of the object (S132 
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The trace mark drawing means does not extinguish the drawn trace 
mark when the object stands still, while the trace mark drawing 
means extinguishes the drawn trace mark quickly at a speed according 
to a moving speed of the object when the object is moving (S132 
5 through S158 ) . This allows the trace mark to follow the movements 
of the object. 

Moreover, it} is preferable that the trace mark drawing means 
delete the dravn trace mark when the object stops and a 
10 predetermined airount of time has passed. This makes it possible 
to reduce the number of display polygons (or slip traces) and to 
lessen a burden on the operation of the CPU. 

The trace mark drawing means has: a cyclic register (as shown 
15 in Figure 10) for retaining positions of respective portions of 
a mark, which consists of the plural portions (as shown in Figure 
9), in a plurality of storage regions which respectively correspond 
to the respective portions of the mark; and a mark top position 
indicating means (as shown in Figures 6 and 8) for indicating a 
20 storage region of the cyclic register , which corresponds to the 



top position of 

A medium of 
computer system 



a mark. 

this invention stores a program for making a 
function as a game device as described above. 



A method of forming picture data of this invention comprises 
the steps of: Jocating an object composed of polygons in a 
three-dimensional virtual space (S202); setting a visual point in 
the three-dimensional virtual space and forming a projected 
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picture by projecting polygons in a display region as seen from 
this visual poiit on a plane of projection (S254); identifying 
whether each polygon is visible or invisible from the visual point 
according to the projected picture formed on the plane of projection 
5 (S256) ; forming object data from data showing whether each polygon 
is visible or invisible (S212 ) ; and relating the visual point with 
the object data (S216). 

A method of ;:orming picture data of this invention comprises 
10 the steps of: locating all objects composed of polygons in a 
three-dimensional space (S202); setting a plurality of visual 
points in the three-dimensional space (S204); forming a projected 
picture for each visual point by pro jec ting , on a plane of 
projection for each visual pointy the polygons within a display 
15 region as seen from each visual point (S252, S254); identifying 
whether each polygon is visible or invisible from each visual point 
according to the projected picture formed on the plane of projection 
data showing whether each polygon is visible or 
invisible from each visual point on the basis of the results of 
20 the identification (S258); forming a plurality of object data by 
making the same of similar patterns into a group ±n accordance with 
each polygon , the data representing whether the 
e or invisible from each visual point (S212) ; and 
table representing object data which can be seen 
point (S216). 



a data pattern of 
polygon is visibl 
forming an object 
25 from each visual 



A medium of this invention stores a program for having a 
computer system execute each step of the above-described method 
of forming picture data. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is; 
5 according to an 



Figure 2 is 
formation. 



a flowchart which explains an algorithm of flare 



Figure 5 is 
15 flare formation. 

Figure 6 is a 



a functional block diagram of a game device 
embodiment of the present invention* 



10 Figure 3 describes conditions of flare generation. 



Figure 4 shows an example of a flare generated screen- 



a flowchart which explains another algorithm of 



graph which explains the algorithm shown in Figure 



20 Figure 7 

by referring to 



describes 



an example in which a flare degree is found 
a table. 



describes 



Figure 8 
generated by movting 



25 



Figure 9 is a 
a tire mark. 



an example in which a flare is intentionally 
a light source. 



flowchart which describes an algorithm to display 



Figure 10 describes the content of RAM, 
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Figure U describes the state of RAM when one round of writing 
has been finished, 



5 Figure 12 describes tire marks drawn by RAM as shown in Figure 

11- 



Figure 13 
RAM number and 



describes a correspondence relationship between the 
the tire mark patterns. 



Figure 14 shows a picture in which slip marks are drawn. 

Figure 15 shows an example of objects located in a three- 
dimensional virtual space. 



Figure 16 s 



lows an example in which the object includes 



invisible portions in a display region. 



Figure 17 
20 (polygons) of 



sliows an example in which the invisible portions 
the object have been deleted. 



Figure 18 is 
picture data proj; 

Figure 19 is 
,of an object dat. 



a block diagram which explains the outline of a 
messing device. 



a flowchart explaining an example of formation 
. base by deleting polygons which are invisible 



from a camera in the display region. 



Figure 20 is 



a flowchart explaining an example in which it is 
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determined whether the polygons are visible or invisible. 



Figure 21 is 
or invisible. 



11 



a table showing whether the polygons are visible 



Figure 2 2 explains how polygon data are made into ob j ect groups . 



Figure 23 
objects to be 



explains a transformation table according to which 
drawn are selected according to the camera ID, 



Figure 24 
as seen from a 



stfows a picture drawn in a three-dimensional mode 
iiormal visual point. 



Figure 25 shows a picture when the visual point is moved upward 
15 in the same three-dimensional virtual space as that of Figure 24. 

DETAILED DESCRIPTION OF THE INVENTION 



The construction of a game device capable of executing an 
20 algorithm concerning pictures of special effects according to this 
invention is hereinafter explained with reference to drawings. 



Figure 1 is a 
device. This dev 
25 the device in its- 
, display of a game 
sound or the like 
elements - 



block diagram showing the outline of a video game 
ice is composed of: a CPU block 10 for controlling 
entirety; a video block 11 for controlling the 
screen; a sound block 12 for generating effect 
; a subsystem 13 for reading a CD-ROM; and other 
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100, a main CPU 



The CPU block 10 is composed of an SCU (System Control Unit) 



101, a RAM 102, a ROM 103, a cartridge I/F la, a 



sub-CPU 104, a GPU bus 103 and other el orients. The main CPU 101 
controls the device in its entirety. This main CPU 101 comprises 
5 the same operating function inside as that of a DSP (Digital Signal 
Processor) and is capable of executing application software at a 
high speed. 



The RAM 102 



is used as a work area for the main CPU 101. the 



10 ROM 103 has, foij example, an initial program for initialization 
written thereon. The SCU 100 is designed to perform smooth input 
and output of data between, for example, the main CPU 101, a VDP 
120 and 130, a ESP 140, and a CPU 141. The SCU 100 comprises a 
DMA controller inside and is capable of transmitting object (or 
15 sprite) data duiing a game to a VRAM within the video block 11. 
This makes it possible to execute application software of, for 
example, a game at a high speed. The cartridge I/F is designed 
to input application software which is supplied in a ROM cartridge 
form. 



20 



The sub-CPU 



.04 is called an SMPC (System Manager & Peripheral 
Control) and is provided with, for example, a function to collect 
peripheral data £rom an input device 2b through a connector 2a upon 
request of the main CPU 101 . The main CPU 101 conducts processing 
25 to move, for exajnple, a car (or object) on a game screen on the 
.basis of the peripheral data received from the sub-CPU 104. An 
operating unit, wiich comprises a handle, an accelerator and a break, 
is connected to the connector 2a. It is also possible to connect 
optional peripherals such as a pad, a joystick or a keyboard to 
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the connector 2a. Connecting two operating units 2b to the 
connector 2a makes it possible to perform a car race for plural 
game players. jDhe sub-CPU 104 is provided with a function to 
automatically recogni2e the type of peripheral connected to the 
5 connector 2a (at a terminal on the main frame side) and to collect 
peripheral data or the like in a communication format in accordance 
with the type of peripheral. 



The video blpck 11 comprises: a VDP (Video Display Processor) 
10 120 whichmainly performs drawing of, for example, objects composed 
of polygon data in a video game; and a VDP 130 which mainly performs 
drawing of background pictures, synthesis of polygon picture data 
(of objects) With the background pictures, and clipping 
processing. 

15 The VDP 120 is connected to a VRAM 121 and a plurality of frame 

buffers (two buffers 122 and 123 are shown in Figure 1) . A command 
which represent objects for a video game device 
main CPU 101 to the SCU 100 and then to the VDP 
written on the VRAM 121. The VDP 120 reads the 
from the VRAM into a system register inside and 



to draw polygons 
is sent from the 
120 and is then 
20 drawing command 



writes drawing data into the frame buffer- Drawing data of the 
frame buffer 122 or 123 is sent to the VDP 130. The VDP 120 is 
provided with, for example, the functions of: texture parts display 
to display objects in fixed forms, expanded or contracted objects, 
25 deformed objects or the like; formless objects display to display 
.quadrilateral polygons, polylines, lines or the like; color 



operations such 



as semitransparent operation between parts, 



semiluminance operation, shadow operation, graduation operation, 



mesh operation 



or shading operation; mesh processing; and 
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20 



operation to perform clipping in order to avoid drawing in regions 
other than the display region which has been set. The vdp 120 also 
comprises a geonetri2er which performs matrix operations and is 
capable of quicrkly performing operations such as expansion, 
5 contraction, rotation, deformation or coordinate transformation- 



The VDP 130 
in a manner such 
outputted to an 
10 the functions 
for example, a 
display and a 
to display 



objects 



The encoder 
the picture data 



is connected to a VRAM 131 and it is constructed 
that picture data outputted from the VDP 130 is 
encoder 160 through a memory 132. In addition to 
thjat the VDP 120 has, the VDP 130 is provided with, 
scrolling function to control a scroll picture 
priority function to determine the priority order 
and pictures. 



160 adds synchronization signals or the like to 
r thereby generating video signals which are then 
outputted to a Tsf picture receiver 5 (or projector) . Accordingly, 
pictures of various kinds of games are displayed on the TV picture 
receiver 5. 

The sound blDck 12 is composed of a DSP 140 for synthesizing 
sound in the PCM format or the FM format, and the CPU 141 for, for 
example, controlling the DSP 140 . Sound data generated by the DSP 
140 are converted, into two-channel signals by a D/A converter 170, 
25 which are then outputted to a speaker 5b. 

The subsystem 13 is composed of a CD-ROM drive lb, a CD I/F 
180, a CPU 181, an MPEG AUDIO 182, an MPEG VIDEO 183 and other 
elements* This subsystem 13 has functions, for example, to read 
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application software supplied in the CD-ROM form and to reproduce 



aniiaation. The 

CD-ROM, The CPl 

CD-ROM drive lb 
data read from a 
the CD I/F 180, 



15 



CD-ROM drive lb is designed to read data from a 
181 performs processing such as control of the 
and correction of errors in the read data. The 
CD-ROM are supplied to the main CPU 101 through 
a bus 106 and the SCU 100 and are utilized as 



application software. The MPEG AUDIO 182 and the MPEG VIDEO 183 
are devices for restoring data which are compressed in the MPEG 
(Motion Picture Expert Group) standards „ Restoration of the MPEG 



10 compressed data, 



which are written on a CD-ROM, by using these MPEG 
AUDIO 182 and MPEG VIDEO 183 makes it possible to reproduce 
animation , 



A first embodiment of special effects in pictures of this 
15 invention is hereinafter explained with reference to Figures 2, 
3 and 4* 

In this embodiment , when a ray enters a so-called virtual camera 
from a light source in course of developments of a game, flares 
20 from the ray are generated in pictures, thereby providing more 
realistic pictures. Figure 2 is a flowchart which explains an 
algorithm of flare formation. Figure 3 explains how conditions 
on the flare formation are determined. Figure 4 shows an example 
which flares are generated. 



25 



of a picture in 



The CPU 101 develops a car race game in a three-dimensional 
virtual space in accordance with a main game program and data of 
driving operatioA (not shown) . The main game program and data are 
supplied by means of an information storage medium such as a ROM 
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cartridge, CD-RCM or floppy disk, and are previously loaded on the 
memory. Moreover, the program and data may be downloaded through 
the medium of communication networks such as the Internet, personal 
computer coimicnication or satellite communication, or 
5 broadcasting. The CPU 101 locates objects such as cars and 
background in the three-dimensional virtual space and controls 
positions, movements or the like of the objects in synchronization 
with frame cycles of the TV picture receiver, 

10 Figure 3 sho*?s a situation where the three-dimensional virtual 

space is observed from a virtual camera which corresponds to a 
visual point of a game player or driver . In Figure 3 , the reference 
numeral 21 is a virtual camera (or a visual point) , the reference 
numeral 22 is a plane of projection which corresponds to a screen 

15 of a television monitor, the reference numeral 23 is the 
three-dimensional virtual space where a game is developed, the 
reference numeral24 is a virtual light source located in the 
three-dimensional virtual space, and the reference numeral 25 is 
a range of view of the virtual camera. The letter "A" indicates 

20 a unit vector on a line linking a camera position and the light 
source. The letter "B" indicates a unit vector existing in a facing 
direction of the virtual camera . The letter " 9 " is an angle formed 
by the vectors A and B. However, as described below, the vector 



is not limited tp the unit vector. 



The CPU 101 determines whether or not a light source polygon 

24 of the sun, street lights or the like is within view (or a screen) 

25 of the virtual camera during the execution of the main game 
program (Si 02)- Objects to be located in the virtual space for 
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each scene are previously made into data bases and f therefore, it 
is possible to acknowledge the existence of the light source object 
according to the individual number of objects listed up for the 



relevant scene. 



If the light 



source object does not exist within view, flares 



are not generated and this picture processing is terminated, 



If the light 



virtual space is 
obtained (S104) 



source object exists , the CPU 101 determines to 
1 0 what extent the camera is facing in the direction of the light source 
or in what position relationship the light source is located within 
view in order to determine, for example, whether or not rays from 
the light source my enter the camera lens or the degree of influence 
of incident light . For this purpose, a segment linking the camera 
15 position with the light source object in the three-dimensional 

found and then the vector A in unit length is 
A facing direction of the camera 21 in the 
three-dimensional virtual space on this scene is found from the 
data base and then the unit vector B which represents the facing 
direction of the camera is obtained (S106). An inner product C 
of the unit vectors A and B, that is , C= ] A j * | B | cos 6 is calculated . 
If the directions of both unit vectors A and B coincide with each 
other, 9 is 0 degrees and the inner product is 1 . On the contrary, 
as the directions of both vectors become wider apart, the inner 
closer to 0 (S108)* in order to reflect the 
light source on the inner product C, the value 
is set as not the unit length " 1 , " but a value 
► the intensity of the light source. In this case, 



25 product becomes 
.intensity of the 
of the vector A 
corresponding to 



the vector A corresponds to an incident light having a direction 
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and size (or strength of light). 

The CPU 101 compares the inner product with a reference value 
which is previously determined as a condition of flare generation- 
It determines w tether or not the inner product C exceeds the 
; or threshold value ) ( S 1 1 0 ) . If the inner product 
C does not exceed the reference value/ flares are not generated 
or it is determined that the circumstances do not require the 
generation of flares. 
10 Accordingly, this picture processing is terminated and returns to 
the main program. The flare processing should be performed to the 
extent that a game player can recognize that a picture is influenced 
by the light source- Otherwise, the flare processing ( for example, 
a fog effect as described below) may cause a kind of deterioration 
15 of picture quality. Such deterioration of picture quality can be 
avoided by the above-described determination (S110). 



If the inner 
101 performs the 
20 product is larger 



25 



product C exceeds the reference value, the CPU 
flare processing. As the value C of the inner 
, it means that a ray comes straight from the light 
source and enterjs the camera lens, thereby stronger flares are 
generated. Accordingly, whiteness is added to a picture in 
value C , thereby causing a so-called "fog effect . " 
This can be realized by changing luminance and chromaticity 
parameters for CDlor operations of the VDP 120 and 130 (S112). 
Subsequently, a transparency D in proportion to the value C is found 
(S114 ) * A line linking the camera position with the light source 
object is converted into a line E on a two-dimensional screen and 
a route of the ray in a screen picture is specified (SI 16) . Flare 
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polygons having 
positions along 



the transparency D are drawn at appropriate 
the line E. For example, if the transparency d 
is seirdtransparint, half of the luminance of a ground picture is 
added to half of t :he luminance of the flare polygons , and the results 
of addition are drawn on the frame buffer, thereby obtaining a flare 
If a plurality of light source polygons which have 
of light exist within view, the above-described 



picture (Si 18). 
a large quantity 



flare generation processing is performed for each polygon. 



Only one of 
may be performed 
Yes), the light 



10 Only one of the fog effect and the flare polygon processing 

. If the light source exists within view (S102: 
source exerts some influence. The degree of 
influence is controlled by the inner product C. Accordingly, it 
is not indispenscible to set a threshold value (SI 10 ) . For example, 
15 if the light source exists within view, the transparency of the 
flare polygons m*y be adjusted according to the inner product C. 
In addition, once the inner product C exceeds the threshold value, 
the fog effect may be caused in proportion to the inner product 
C. Moreover, It is possible to adjust the whiteness and 
20 transparency of the picture by considering the type of the light 
source such as tjie sun or street light, and the intensity of the 
light source . 



Figure 4 shqws 
25 picture during a 
'exists on the uppkr 
polygons and cirqle 
line E (not shown!) 
to generally cirqular 



a situation where flares are generated in a 
race- In this example, the light source object 
right side of the screen and ring-shaped flare 
-shaped flare polygons are displayed along the 
The shape of the flare polygons is not limited 
contours as shown in Figure 4 . For example, 



20 



the flare polygons may have polygonal contours, other than the 
semitransparent processing of the flare polygons, the flare 
polygons which have been previously formed may be displayed as they 
are without performing the semitransparent processing- If such 
flare polygons are displayed in the expression form of flashing 
by repeatedly displaying and extinguishing the flare polygons , the 
backside of the flare polygons can be seen intermittently. 



Accordingly, the 



same effect can be obtained as in the case where 



a figure with its inside not extinct, that is, the figure which 
10 is not hollow or annular is made into a figure without its inside, 
or as in the case where the flare polygons are made semitransparent . 
Therefore, the background can be seen and the operations of a game 
will not be obstructed. It is also possible to make the flare 
polygons look like real flares - 

15 

Display of flares is not limited to the display of the flare 
polygons . Flat figures representing flares may be used to perform 
picture synthesis. In the case of flare flashing as described 
above, it is possible to use flares formed with flat figures (or 
20 preferably hollcw figures, or generally circular or polygonal 
figures corresponding to lens flares) which are tinted color with 
higher whiteness than the background because of the fog effect, 
to perform the picture synthesis, and to display a plurality of 
figures similar to such flat figures on a line which corresponds 
25 to an incident light and which links the visual point with the light 
.source. In this case, a burden on operations is comparatively 
small 



Figures 5 and 



6 show another embodiment of the flare processing. 
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In this exanple. Step S110 of the flowchart shown in Figure 2 is 
modified. As shown in Figure 6 , an upper limit CU and a lower limit 
CL are set in using the value C of the inner product. If the inner 
product C exceeds the upper limit CU (3110a: CU<C), the inner 

5 product is set at the value CU (SllOd). This makes it possible 
to prevent a picture from becoming too white because of the flares. 
If the inner proauct C is less than the lower limit (SI 10a: C<CL) , 
the inner product. C is set at the value CL (SllOb) in order to produce 
a constant flare effect. Moreover, if the inner product c is 

10 between the uppJr limit CU and the lower limit CL (SlOOar CL^ C 
^ CU) , a modification function f (C) is used to obtain a modified 
value C'=f (C) . As described above, it is possible to perform the 



flare processing 
as appropriate 



more effectively by modifying the inner product 



In the example as shown in Figure 2, the inner product C is 
utilized to determine the flare degree. However, it is possible 
to perform simile r processing without necessarily calculating the 
inner product C 

Figure 7 shows two examples in which the flare degree is 
determined by referring to tables. The flare degree is also 
represented as C for convenience. 



25 If a virtual light source exists on the screen at the 

, aforementioned step S102 (S102: Yes), the flare value C 
corresponding to a position of the virtual light source ( for example, 
an angle 8 formed by the vector A and the vector B) can be decided 



by referring to a 



table shown in Figure 7(a). The position of the 
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virtual light source may have a coordinate value (x, y ) on the screen 
or within view 25 . It is possible to previously store such a table 
on a CD-ROM lb as a data base and to read it when starting a game 
and retain it on the RAM 102, 

Moreover^ it is possible to obtain a flare value Cnn 
corresponding tc a position of the light source Bn and intensity 
to a table for finding the intensity of flares 
the intensity of the light source. Although not 
1 0 specifically shown in the drawing , if the flare degree is determined 
in accordance with the intensity of the light source, the table 
which retains the flare value C which conforms only to the intensity 
of the light source may be used- The flare value C so obtained 
can be used in the sane manner as the inner product C at and after 
15 step SI 00 . It is also possible to perform the same flare processing- 
If the flare degree is determined by referring to a table, anything 
(such as morning - evening, rain, fog, or existence of clouds) can 
be included as parameters in addition to the position and intensity 
of the light source as descril>ed above. The content of the table 
20 is not limited to what is shown in Figure 7. 

Instead of tie above-described table, functions which serve 
similarly to the table, such as C=g( 9 , P) , C=h( 9), C=i(P) orC=j(x, 
y)z may be used. 



25 



An explanation is hereinafter given concerning the case where 
flares are utilized. A position of the virtual sun in a so-called 
world coordinate system is originally settled. However, in order 
to make it easy to play a race game, it is possible to move the 
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position of the 
not be generated 



virtual sun as appropriate so that backlight will 
On the contrary, in order to enhance the stage 



effect of a game, it is possible to place the virtual sun where 
the virtual sun originally does not exist and intentionally create 
5 a backlight situation , thereby causing flares. 

For example, as shown in Figure 8, it is possible to produce 
the climax of a game by intentionally moving the virtual sun from 
the regular position of the virtual sun to a position to come into 
10 view after a goal and by generating flares in pictures after the 
goal. 

An algorithm of a second special effects picture is hereinafter 
explained with reference to Figures 9 through 14. This algorithm 

15 is to express car spinning , tire slips, driving on a bad road, etc. 
more realistically by leaving traces of tires on a road. Moreover, 
the amount of operations for the picture processing is decreased 
by reducing polyc ons (or traces of tires ) on the screen by deleting 
the traces of tites after a certain amount of time has elapsed. 

20 Since the traces of tires themselves are not necessary as driving 
information for a game, the traces are gradually deleted from their 
bottoms in a natural manner so that the amount of information will 



not become excessive 



25 Figure 9 is a flowchart which explains an algorithm to display 

. tire traces (or tire marks ) . Figures 10 through 13 explain reading 
of data, display of the tire marks, etc . Figure 14 shows an example 
where the tire marks are drawn. 
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In this 
concerning 
patterns 0 
realistically, 
storage regions 
used in order to 
car tires and 



embpdijnent, for example, five kinds of tire marks 
which density becomes gradually higher, that is, 
through 4 are used to express the tire traces 
Each pattern is stored in a data base (ROM) . Five 
of the RAM or registers as shown in Figure 10 are 
cause the tire traces to follow the movements of 
gradually extinguish the traces. 



to 



At first f the maim program determines whether or not display 
1 0 conditions of the tire marks are satisfied . In other words , a tire 
mark display routine is executed by determining, for example, 
whether or not tire slips have occurred due to spinning of a car 
or abrupt pressing on the accelerator or whether or not a car is 
running on a bad road by referring to the relevant functions or 



Once a tire 



15 flags which indicate driving conditions. 



slip starts, the CPU 101 reads a previous tire 
position X^j. fron, among five RAMs, a top mark RAM at which a top 
mark flag representing a top position of a tire mark is set, and 
20 calculates a distance L(=T^ - X^) between the previous tire 
position and a p] resent tire position T^ displayed on the screen, 
new mark length L (S132) . The position and 
herein used mean coordinate values in the 
three-dimensional virtual space. The CPU 101 determines whether 
25 or not the tire mark length L exceeds a maximum length 1 of a basic 
.pattern of the tire mark (S134), 



thereby making a 
the position 



If the tire 

1 (S134: No), the 



mark length L does not exceed the maximum length 
<c?U 101 causes the top mark RAM to store the present 
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tire position T w as an ending position of the tire mark (S144) . 
The tire mark length L is stored in the top mark SAM (S146) . The 
CPU 101 causes the number of the top mark RAM to be retained as 
it is without updating the content of the flag register for storing 
the number of the RAM at which the top mark flag should be set ( S 14 8 ) • 

The RAM number is matched with the patterns as shown in Figure 
13 . Data is read from the top mark RAM in a cyclic manner, thereby 
drawing the tire mark. In other words, the top mark RAM No. 0 is 
matched with the pattern 4, the top mark ham no. 1 is matched with 
the pattern 3, the top mark RAM No. 2 is matched with the pattern 
2, the top mark RAM No. 3 is matched with the pattern 1, and the 
top mark RAM No. 4 is matched with the pattern 0. As the pattern 
changes from pattern 0 to pattern 4 , density of the tixe mark changes 
from a light color to a dark color. The number of the top mark 
RAM represents al newest tire trace in terms of time. 



The CPU 101 reads out the darkest pattern (pattern 4) (S150) . 
It reads a tire nark beginning position X^, a tire mark ending 
20 position T^ and a length L from the RAM and displays the patterns 
on the screen (SI 52) . It determines whether or not display of all 
the patterns for the number of RAMs has been completed (3154). 

If the tire mark beginning; ending and length are stored in 
25 a plurality of RAMs by the preceding tire mark processing (S154: 

designates that the RAM number be checked in a 
the downstream order (S156), and reads the tire 
mark patterns which become lighter in color step by step or 
gradually in the downstream order in accordance with the RAM number 



.No), the CPU 101 
cyclic manner in 
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(S158) . When display of the patterns for the number of RMs have 
been finished (^154: Yes), the CPU 101 once returns to the main 
program, 

while the ti:e mark display conditions are satisfied and until 
the tire mark length L exceeds the maximum tire mark length 1 , steps 
S132, S134, S144 through S154 are repeated and the tire marks are 
drawn in a manner such that the darkest pattern immediately follows 
the tire 



to zero (S138) 



If the mark length L exceeds the maximum mark length 1 (S134: 
Yes), a mark position Pe(=3^ + 1) corresponding to the maximum 
mark length 1 is stored as the mark ending position (S136). The 
number of the tori mark RAM is increased by one. If the HAM number 
15 exceeds a maximun value ( "4" in this case) , the RAM number returns 

The mark beginning position Pe is stored in a new 
top mark RAM (S140). The present tire position T^ and the tire 
mark beginning position Pe are used to find the tire mark length 
L(=T JC1 - Pe) by calculation (S142). The present tire position T„ 
20 is stored as the mark ending position in the top mark RAM (Si 44) . 
The tire mark length L is stored in the top mark RAM (S146) . The 
RAM number to be stored in the flag register is set at the number 
of the top mark iiam updated at S138 (S148). The darkest pattern 
(pattern 4) is read out (S150). The tire mark beginning position 
25 Pe, ending position T^ and length L are read from the RAM and the 
patterns are displayed on the screen (SI 52). It is determined 
whether or not display of all the patterns for the number of RAMs 
have been finished (S154)* 
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If the tire mark beginning, ending and length are stored in 
a plurality of RAMS by the preceding tire mark processing (S154: 
No), the CPU 101 designates that the RAM number be checked in a 
cyclic manner in the downstream order (5156), and reads the tire 
5 mark patterns which become lighter in color step by step or 
gradually in the Lownstream order in accordance with the RAM number 
(S158). 

The above-described tire mark drawing processing is executed 
10 and the tire marks are drawn on the screen while the tire mark 
display conditions are satisfied upon the execution of the main 
program* 

An explanation is hereinafter given with reference to Figures 
15 10(a) through lo|(e) about data retained in RAMO through RAM4 and 
updating of the retained data in the flag register by means of the 



above-des cribed 

Figure 10(a) 
20 mark caused by a 



algorithm. 

explains the case where the length L of the tire 
slip is Al, that is, less than the mark reference 



value 1 (S134: No). 

If the top mark indicates RAMO , the tire mark beginning position 
XO and the present position are read in at step S132 and the 



25 length L=Al(=T x: 



is calculated. The initial tire mark 



beginning position X 0 is the tire position when a slip starts. 
These values are stored in RAM0 (S144 through S146) . RAM0 is made 
the number of the top mark RAM to be retained in the flag register 
(S148). As shown in Figure 13, the number of the top mark RAM 
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corresponds to the darkest pattern 4. The beginning/ ending and 
length of the tire mark are read from RAMO and the tire mark is 
drawn according to the pattern 4 (3152). In this case, there is 
one RAM in which data are written (S154: Yes), this routine is 
5 terminated to re J ;urn to the main program. If the tire mark display 
conditions are satisfied, until the mark length L exceeds the 
maximum length 1, the above-described processing is repeated and 
the tire mark of the pattern 4 is extended. 



10 



As shown in 
T^ and the length 



Figure 10(b), the present tire position becomes 
L(=T X2 -X 0 = 1 + Al) exceeds the maximum mark length 
1 (S134: Yes) • k^Xo+l^Pe) is found and the position X L is stored 
as the mark ending position in RAHO (S136) . The top mark RAM is 
made RAMI (S138). The present tire position T^ and the mark 
15 beginning positibn X a are used to calculate the mark length L (=A 



l-T^-XJ (S142)- 



20 



to RAMI (S150). 

according to the 



25 



The present tire position is made the mark 
ending position c nd is stored in RAMI (S144 ) * The mark length L(=A 
1^-XO is stored in RAMI. The number of the top mark RAM to be 
retained in the flag register and to be read out in a cyclic manner 
is set as RAMI (S\48) . Data of the pattern 4 is made to correspond 
The dark tire mark of the pattern 4 is drawn 
data of RAMI (S152) • Moreover, the tire mark of 
the pattern 3 is drawn according to the data stored in RAMO (S154, 
S156, S158 and Si.52). Then the CPU returns to the main program- 
As shown in Figures 10(c) through 10(e), by repeating the 
above-described jprocessing in the same way, drawing data of the 
tire mark (the beginning, ending and length of the tire mark) are 
retained in RAMO through RAM4. 
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Figure 11 shows an example where one round of data preservation 
onto RAMO through RAM4 have been completed. Since there are five 
RMs in this embbdiment, rewriting is conducted in serial order. 



5 Figure 11(a) shows a situation where one round of rewriting is 
completed and the top position of the tire mark corresponds to . 
Figure 11(b) shows a situation where one round of rewriting is 
completed and the top position is located at RAM3 . Since the 
previous data portion of the tire mark which has been rewritten 

10 is not displayed, the relevant pattern drawn on the screen is 
extinguished. If the position coordinate X„ is located out of view 
of the virtual camera , such a position will be regarded as beijig 
not subject to the picture processing and, therefore, will not be 
displayed by means of clipping* 

15 



Figure 12(a) 
11(a) is drawn as 
length of Al and 
a pattern length 
20 pattern 4 to the 



explains the case where the data shown in Figure 
a tire mark. The pattern 4 is drawn in a pattern 
each of the patterns 3,2,1 and 0 is drawn in 
of 1. Drawing density becomes lighter from the 
pattern 0. Figure 12(b) shows a tire mark drawn 
by using the data shown in Figure 11(b). A drawing range of the 
tire mark has moved from the position X 3 through T xa of Figure 12 (a) 
to the position X, through T^, following the tire object of a car- 
The tire mark of the position range X 3 through X< has been 
25 extinguished. This limits the tire trace to a predetermined 
a length and prevents the amount of operations necessary to display 
the tire mark from increasing too much. 



According to 



the algorithm explained with reference to the 
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flowchart of Figure 9, when a car stands still, the position 
infontiation in S&MQ through KAM4 is retained and, therefore, the 
tire mark is being displayed on the screen. On the other hand, 
when the car is noving, the tire mark is drawn, following the tire. 

5 This tire mark becomes lighter in color at its bottom. If a moving 
speed of the car is fast, a travel amount L of tires from the position 
where sampling was performed the last time exceeds the maximum mark 
length 1 in a si sort period of time. This causes the position 
information in BAMO through RAM4 to shift and the bottom of the 

10 tire mark is quickly extinguished- As a result, the timing to 
extinguish the drawn tire traces is adjusted in accordance with 
the moving speed of the car. Such a method of drawing pictures 
makes it possible to save memory consumption , compared to a 
conventional method of preparing various pictures with tire traces 

15 drawn in advance (which requires an enormous amount of memory) and 
of selecting an appropriate picture out of such pictures . A racing 
car moves at a high speed. In such a situation, if it is set to 
quickly extinguish the tire marks on a course, the number of 
polygons of a game player's car and opponent cars within view can 

20 be reduced and a ourden on the operational processing for picture 
drawing can be lessened. If the tire marks continue to be displayed 
indefinitely, it will interfere with the game. However, there is 
no fear of such interference regarding the present application 
because the tire 



marks are extinguished at an appropriate time. 



In the above -described example, a plurality of tire trace 
patterns (or polygons of traces ) of different density are prepared 
in advance (Figure 13 ) and appropriate trace patterns are selected 
to draw the entire traces. However, it is possible to adopt other 
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methods. For example, at the step of drawing a tire mark which 
gradually becomes lighter in color (step S158), a trace mark of 
predetermined density may be obtained by perf orming the processing 
to make the daricest tire trace mark (which is a basic pattern) 
5 semitransparent , Specifically speaking, transparency for the 
transparency processing at the above-mentioned step is selected 
from a plurality of transparencies which are set by steps according 
to the number of execution of the routine (S152 through S158). 
Respective trace marks which have undergone the semitransparent 

10 processing with different transparencies are combined to form the 
entire trace. This method gives rise to the same results as those 
in the aforementioned case where a plurality of tire trace patters 
of different density are prepared to form the entire trace of 
density gradually changing from the top to the bottom* Furthermore , 

15 concerning the trace mark consisting of a plurality of polygons, 
which is displayisd according to the routine as shown in Figure 9, 



the polygons are 



made gradually lighter in color by means of the 



sanitransparent processing and are then extinguished in the order 
first displayed 'the size of polygons does not change at the step 
20 of making them lighter), and when the polygons become no longer 
visible in the eid, such polygons themselves are removed out of 
the object of the processing {step S154, Figure 12(b)). 



Figure 14 
25 ( or slip traces ) 
4 closer to the 
positions of the 



shows an example where a car spins and tire marks 
are drawn on the screen. A portion of the marks 
tires are drawn in dark color and the beginning 
tire marks are drawn in light color. 



When a tire slip occurs due to, for example, a spin of a car 
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tire slip traces are displayed immediately after 
the slip, a game: player will perceive the realistic expression. 
However/ if a certain amount of time has passed from the occurrence 
of the slip, the game player's attention to the slip traces will 
decrease. Accordingly/ after the car stops moving and a 
predetermined antount of time has elapsed, it may be decided to 
extinguish the slip traces actively. This makes it possible to 
reduce the number of display polygons ( or slip traces ) and to lessen 
the burden on operations of the CPU. 

In the above-described embodiment, an explanation has been 



give with regard 



to the tire marks. However, this embodiment can 



be also applied :o, for example, running traces of a car running 
on a bad road in a rally, running traces of skis (or track of skis 
15 in the snow), traces of jet skis, or wakes behind a ship. 

An explanation is hereinafter given about a reduction in the 
amount of operations with a video game device. Concerning objects 
to be projected on a monitor by means of so-called three-dimens ional 

20 graphics, the arithmetic processing is performed such as placement 
of the objects into the three-dimensional virtual space, 
projection transformation for drawing the objects on a plane of 
projection, modeling transformation, and viewing transformation, 
thereby forminj monitor pictures. Upon perspective 

25 transformation, a clipping is performed by forming a view pyramid 
,and by removing and not displaying the portions outside the display 
region to be actually projected on the plane of projection. This 
clipping contributes to a reduction of the amount of operations . 
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Aaother 
even in the 
amount of opera* 



embodiment of this invention performs the clipping 
region and is intended to further reduce the 



display 



ions , 



The outline of such an embodiment is explained with reference 
to Figures 15 through 17. Figure 15 shows objects A and B located 
in the three-dimensional virtual space. Objects A and B are 
respectively composed of a plurality of polygons. As in 
conventional cases, objects in the display regions are read from 
are located in the original shape at relevant 
positions. Textiures (or patterns) are pasted on the surface of 
polygons . 

Figure 16 shows an example where object B is placed behind 
15 object A when a camera position (or visual point) for projection 
transformation is located at the back off to the left. In this 
case, a portion of object b (the portion which is located behind 
object A) is invisible from the camera position. Accordingly, if 
a data base of the objects is constructed by omitting polygons of 
20 the invisible portion , the amount of operations for the three- 
dimensional graphics display decreases. 

Figure 17 shows an example where polygons of object B are partly 
omitted- Even if such omission of polygons is conducted, a 
25 resultant picture on the plane of projection as seen from the camera 
'is the same as tiat of Figure 16. 



For example, in a car race, cars run on a previously determined 
course. The course is divided into portions in unit length. 
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Concerning scenes which can be seen from the camera for each unit, 



a data base is 
background and a 



previously made in the forra of, for example, 
set of objects, and data of a relevant scene is 



read out according to the position of a car and is displayed as 
5 background, etc, on the screen. Accordingly, it is possible to 
provide a data base which requires a smaller amount of operations 
with a game device by reducing the polygons which cannot be actually 
seen from the camera, 

1 0 An explanation is hereinafter given with reference to drawings 

about a method cf constructing a data base of objects with some 
polygons which cannot be seen from the camera position within the 
display region being omitted. 

15 First, the outline of a picture data processing device for 

executing an algorithm described below is explained by referring 
to Figure 18. The picture data processing device is composed of 
a computer systeir., which is divided roughly into: a data processing 
portion 200; an operational portion 201; a storage portion 202 for 

20 retaining data bases such as object tables and polygon data; and 
a CRT display portion 203 for displaying pictures. The data 
processing portion 200 is composed of: an arithmetic processing 
control portion 211 for controlling respective parts in accordance 
with programs retained in a memory 212; a camera position control 

25 portion 213 for setting coordinates of a camera (or visual point) 
^position in the three-dimensional virtual space in accordance with 
movements of a car or game programs; an object table deciding 
portion 214 for deciding an object table corresponding to the camera 
position by referring to the camera position; a coordinate 
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transformation :natrix generating portion 215 for generating a 
matrix of coordinate transformation corresponding to the camera 
position; a polygon memory control portion 216 for designating 
relevant polygons by referring to the object table; a polygon memory 

217 for outputting the designated polygon data; a texture memory 

218 for retaining textures to be pasted on the polygons? a 
coordinate transformation portion 219 for locating the polygons 
in the three-dimensional virtual space, pasting the textures on 
the polygons, and performing, for example, projection 
transformation by means of the above-mentioned transformation 
matrix to transform the polygons into an image on the two- 
dimensional screen; a drawing portion 220 for outputting a screen 
picture to a picture memory 221; a picture display control circuit 
222 for outputting picture data retained in the picture memory 221 



15 as picture signa 



Is to a CHT display. 



Figure 19 is a flowchart which explains an algorithm to 
construct a data base of objects with some polygons which cannot 
be seen being omitted, by using a conventional object data base. 



At first, a data base of three-dimensional graphics is composed 
by a conventionll method or a data base of three-dimensional 
graphics which has already been composed is prepared. Data of all 
polygons is loaded from the data base onto a work area of a CPU 
25 manory. The polygon data includes coordinate data {S202). A 
, number for identification (or polygon ID) is given to each polygon. 
For example, the polygons are numbered in the order of loading 
(S204). 
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Data of the 
camera position 
(or vector) of 
(or camera ID) is 
5 the camera 



Camera position is loaded onto the work area . The 
lata includes coordinates and a facing direction 
camera (S206). The number for identification 
given to the camera position data. For example, 
is numbered in the order of loading (S208). 



the 



position 



Subsequently, concerning all the camera positions, a 
visibility determining processing as to whether each polygon can 
be seen from the camera positions is performed (S210). 



10 



Figure 20 is a flowchart showing an algorithm of the visibility 
determining processing. This processing locates all the objects 
in the three-dimensional virtual space formed in the computer 
system and draws all the polygons • In doing so , it gives a relevant 

15 polygon ID number to picture elements of each polygon (S252) . It 
performs coordinate transformation/ etc. at each camera position 
(or camera ID) and then draws a projected picture as seen from the 
camera. At this time, a method such as the so-called 2 buffer method 
is used to draw, among overlapping polygons in the display regions , 

20 the polygons located in front as visible polygons and not to draw 
the polygons located in the back (S254 ) . It is determined at each 



camera position 



according to the polygon ID given to the drawn 
picture element which polygons are to be drawn or not to be drawn 
on the screen ( S2:S6 ) . A visible flag table showing which polygons 
25 are visible or invisible at all the camera positions (or camera 
ID) is prepared (S258). Then, the processing returns to the 
original routine. 

Figure 21 shows an example of the visible flag table . It shows , 
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regarding all polygons at all the camera positions (or camera ID) , 
relevant polygon can be seen from a relevant camera 



position {or camera ID) . If it can be seen, a flag "1" is displayed. 



seen, a flag M 0" is displayed- 



Subsequently, in order to obtain a data base which represents 
objects to be drawn at each camera position, polygons which have 
the same or similar patterns of visible flags in the visible flag 
table are made into a group and each group constitutes object data 
(S212) . An identification number (or object ID) is given to each 



object data (S2 



4). 



This procedure is hereinafter explained- Firstly, since a 
polygon (for example, POLY4) having a flag pattern with all M 0" 

15 cannot be seen on the screen, it is unnecessary to consider it as 
an object to be drawn. Such a polygon is extinguished. Secondly, 
as shown in Figure 22(a), a first polygon POLY0 is put in object 
data OB JO . Thirdly , all polygons with flag patterns which coincide 
with the flag pattern of the polygon POLY0 are extracted and added 

20 to the object da : :a OB JO (Figure 22(b)). The above steps 2 and 3 
are repeated regarding the rest of the polygons, and polygons 
having the same flag patterns are gathered and made into groups 
and the respective groups are named object data 0BJ1, 0BJ2 and so 



on. 



Next, polygons with similar flag patterns to those of the object 
data are extracted and incorporated into the relevant object data 
(Figure 22(c)), For example, polygons with flag patterns which 
are different by one bit from a pattern obtained by a logical sum 
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of the respective polygons in the object data are 
extracted and : incorporated into the object data. The same 
procedure is repeated and the polygons are made into groups (or 
object data) urtil the flag patterns which are different by 
5 predetermined b:.ts are checked. 



Subsequently/ a transformation table showing object data which 
are to be drawn (or can be seen) at each camera position is prepared 
(S216) , Figure :>3 shows an example of this transformation table. 
Objects to be located at each camera position (or camera ID) in 
the three-dimensional virtual space can be found immediately by 
referring to this table. 



For example, 



at camera position 0 , object data OBJO, 0BJ1 , 0BJ3 



15 and so on are Iqcated. At camera position 1, object data OBJO, 
0BJ3 and so on ard located . With a game device, the camera position 
is selected in accordance with developments of a game, and relevant 
object data groups are read from the transformation table and 
polygons composing each object are drawn, thereby drawing each 



scene . 



Moreover, the object data are stored in a data base (S218). 
The transformation table of the objects is stored in a data base 
(S220) . 

It is also possible to execute the above-described algorithm 
at a high speed by using a picture processing computer system 
separate from a video game device and to store, on an information 
storage medium, rhe resultant data base of object data as game 
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software together with programs, 



Figures 24 
object data with 
being omitted 



and 25 show examples of pictures drawn by using 
polygons which cannot be seen in the display region 
figure 24 shows an example of one scene at a regular 



camera position during a car race with cars running in a game field 
formed in the three-dijuensional virtual space. Figure 25 shows 
the same scene as seen from above- In the region indicated with 



oblique lines ir 



10 exists. Accordingly/ the amount of operations necessary to, for 



st the virtual space or transform pictures for such 



Figure 25, no polygons are drawn and no picture 



example, constru 
a region is reduced. 

Application of clipping to objects existing in view as 
described above is not limited to video games like the above- 
described embodiments . For example, it can be applied to anything 
which displays the state of the three-dimensional virtual space 
by transforming it into two-dimensional pictures, such as various 
kinds of simulation for virtual experience. As described above, 
20 since this invention is capable of expressing flares caused by 
incident rays from a light source, it is possible to enjoy dazzling 
scenes or dramatically presented scenes. 



Moreover, 
25 moving objects 
, increasing the 



this 



is invention makes it possible to draw traces of 
such as cars or skis without comparatively 
niimber of polygons, which is a desirable feature. 



Furthermore, 
an object data 



by a picture forming method of this invention/ 
b$se is formed by clipping invisible polygons in 
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the display region. Therefore, it is possible to draw the same 
pictures as those drawn by conventional methods by spending a 
smaller amount oi: operations than that of the conventional methods . 
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is: 



1 . A game aevice for displaying , as a picture, a scene having 
come into view by moving a visual point in a three-dimensional 
virtual space, said game device comprising flare processing means 
for forming a flare in said picture when a light source exists within 
10 view of said visv al point, said flare processing means comprising; 

line-of-sight vector generating means for obtaining a 
line-of -sight vector which shows a line-of-sight direction of said 
visual point; 

ray vector g ! enerating means for obtaining a ray vector which 
15 shows a direction of the light source from said visual point; 

inner product calculating means for calculating an inner 
product of said line-of-sight vector and said ray vector; and 

flare forming means for forming a flare having intensity 
according to said inner product in said picture* 



2, A game device according to claim 1, wherein said flare 
processing means further comprises determining means for 
activating said flare forming means on the basis of results of 
comparison of said inner product with a reference value. 

3. A game device according to claim 1, wherein said flare 
forming means increases a degree of whiteness of said picture in 
accordance with said inner product. 
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4- A game device according to claim 1, wherein said flare 
forming means forms a picture of a flare polygon having transparency 
according to said inner product. 

5 5. A game device according to claim 1/ wherein said flare 

forming means conducts/ with said inner product being between a 
predetermined upper limit and a predetermined lower limit, the 
processing to add whiteness to the picture according to said inner 
product and/or pie processing to form a flare polygon having 
10 transparency according to said inner product. 



6* A game device according to claim 1/ wherein said flare 
forming means forms said flare on a straight line linking said 
visual point with said light source. 



15 



7 . A game device for displaying, as a picture, a scene having 
come into view ty moving a visual point in a three-dimensional 
virtual space, said game device comprising flare processing means 
for forming a flare in said picture when a light source exists within 

20 view of said visual point, said flare processing means determining 
a degree of said flare in accordance with a position of said light 
source within view and/or intensity of said light source* 

8. A game device according to claim 7, wherein said flare 
25 processing means determines the degree of said flare by referring 

to a table containing a group of flare values, said table matching 
the degree of saicl flare to the position of said light source within 
view and/or the intensity of said light source. 
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A game device according to claim 7 , wherein said flare 
processing meand finds the degree of said flare by using a function 
including as a variable of the position of said light source within 
view and/or the intensity of said light source. 

10. A game device according to claim 7, wherein said flare 
processing means expresses the flare by displaying, on a screen, 
a flat figure having a comparatively higher degree of whiteness 
than that of the background or a hollow flat figure, 

11. A game device according to claim 10, wherein said flare 



processing means 



repeats display and no display of said flare in 



a short period of time 



ievice according to claim 7 , wherein said flare 
displays a plurality of said flares on a straight 
line corresponding to an incident ray. 



15 12. A game 

processing means 



13. A game 
20 plurality of flares 



device according to claim 12, wherein said 
displayed include similar figures. 



virtual 



14. A game 
source is a 
space, said sun 
25 three-dimensional 
t predetermined s 
on the 



device according to claim 7, wherein said light 
sun located in said three-dimensional virtual 
being relocated from a normal position in said 
virtual space to a position within view of a 
in order to generate said flare in said picture 
scene. 



cene 



predetermined 



15. A game device for displaying, as a picture, an object 
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moving in accordance with developments of a game, said game device 
comprising: 

means for reading a present position of said object; 

and 

trace mark cbrawing means for drawing a trace mark in length 
within a predetermined range from said present position and for 
extinguishing a bottom position of said trace mark by making it 
gradually lighter in color with the lapse of time. 



10 16. A game 

mark consists of 
trace pattern 
the bottom 



device according to claim 15, wherein said trace 
plural portions, each portion having an assigned 
which becomes lighter from the top position toward 
of said trace mark. 



positxon 



15 17, A game device according to claim 16 , wherein the trace 

pattern assigned to said each portion is previously stored as a 
pattern having different density in a storage means. 



18. A game 
20 pattern assigned 
transparency of 



device according to clain 16, wherein said trace 
to said each portion is obtained by changing the 
a basic trace pattern. 



19. A game device according to claim 15, wherein said trace 
mark drawing means extends only the top position of said trace mark 
when the present position of said object is located less than a 
.predetermined value apart from the top position of the drawn trace 
mark; and said trace mark drawing means moves , by said predetermined 
value, said trace mark in its entirety toward the present position 
of said object when the present position of said object is located 
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not less than said predetermined value apart from the top position 
of -the drawn trace mark. 



20. A game 
mark drawing meams 
according to a 



device according to claim 15 , wherein said trace 
adjusts the timing to extinguish the drawn trace 
ihoving speed of said object. 



21. A game 
mark drawing 
10 said object 

extinguishes the 
speed of said 



means 



stands 



device according to claim 15, wherein said trace 
does not extinguish the drawn trace mark when 
still, while said trace mark drawing means 
drawn trace mark at a speed according to a moving 
when said object is moving. 



object 



22. A game device according to claim 15, wherein said trace 
15 mark drawing meais deletes the drawn trace mark when said object 
stops and a predetermined time has passed. 



means 



23 . A game 
mark drawing 

20 of respective 
portions , in a 
relate to the 
and mark top 
region of the cycl 

25 of a mark 



portions 



device according to claim 16, wherein said trace 
has: a cyclic register for retaining positions 
of a mark, which consists of said plural 
plurality of storage regions which respectively 
respective portions of the mark; 

indicating means for indicating a storage 
ic register, which corresponds to the top position 



position 



24 . A medium 
making a computer 
claim 1. 



with a program stored thereon, the program for 
system function as a game device according to 
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25. A method of forming picture data, comprising the steps 



of: 



locating an object composed of polygons in a three-dimensional 
5 virtual space; 

setting a visual point in the three-dimensional virtual space 
and forming a projected picture by projecting polygons in a display 
region as seen rrom this visual point on a plane of projection; 

identifying whether each polygon is visible or invisible from 
10 said visual point according to the projected picture formed on said 
plane of projection; 

forming object data f ran data showing whether each polygon is 
visible or invisible; and 

relating saxd visual point with the object data. 



Of: 



26. A method of forming picture data, comprising the steps 



locating all objects composed of polygons in a three- 
dimensional virtual space; 

setting a plurality of visual points in the three-dimensional 
virtual space; 

forming a projected picture for each visual point by projecting , 
on a plane of projection for each visual point, the polygons within 
a display region as seen from each visual point; 

identifying whether each polygon is visible or invisible from 



t each visual point 



plane of projection; 



forming data 



according to the projected picture formed on said 



showing whether each polygon is visible or 



invisible from each visual point on the basis of the results of 
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identification 



said i 

forming a 
patterns into a 
polygon , the 
invisible from 

forming an 
each visual point 



plurality of object data by making the same or similar 
group in accordance with a data pattern of each 
data representing whether the polygon is visible or 
each visual point; and 

object table representing object data as seen from 



27. A medium with a program stored thereon, the program for 
10 having a computer system execute each step according to claim 25. 
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ABSTRACT 



It is an object of the present invention to provide special 
5 effects which will make a video game more realistic. 

When a virtual light source exists in a three-dimensional 
virtual space, if a light from the light source extends toward a 
camera, a flare is generated on a screen because of incidence of 
10 the ray of light, into a camera lens, thereby forming a dazzling 
picture in accordance with the state of backlight. 
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OBTAIN A UNIT VECTOR A UNKING 
A CAMERA POSITION WITH A LIGHT 
I SOURCE POSITION. 



OBTAIN A UNIT VECTOR B REPRESENTING 
A FACING DIRECTION OF THE CAMERA. 



S106 



FIND £N INNER PRODUCT C OF A AND B 




ADD WHITENESS TO THE PICTURE 
IN PROPORTION TO THE VALUE OF C. 



FIND TRANSPARENCY D 
IN PROPORTION TO THE VALUE OF C. 



TRANSFORM A STRAIGHT LINE LINKING 
THE CAMERA POSITION WITH THE LIGHT 
SOURCE POSITION INTO LINE E ON A 
TWO-DIMENSIONAL SCREEN. 



S116 



DRAW FLARE POLYGONS OF TRANSPARENCY 
D AT APPROPRIATE POSITIONS ON LINE E. 
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